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ABSTRACT 

The instructional effectiveness of elementary 
classroom teachers is investigated through the use of distributions 
of student achievement scores. The data used for this investigation 
were reading, language, and arithmetic subtest scores on the 
Comprehensive Tests of Basic Skills for fifth and sixth grade public 
school children. Students vere classified by their grade equivalent 
scores on each of the subtests. For each teacher in each of the 
grades, the scores vere computed for each of their students. Upon 
grouping of students, each teacher received nine data points; mean 
gain scores for slow, average and fast students in reading, language 
and arithmetic. It was then determined which cluster of teachers was 
most effective with certain students and then to follow these 
teachers the second year of the study and reinvestigate their 
effectiveness. Results indicate that it may be possible to determine 
that certain teachers are more successful in working with certain 
types of students in various subject areas and at differing 
abilities. (DEF) 



*********************************************************************** 

♦ Documents acquired by ERIC include many informal unpublished ♦ 

♦ materials not available from other sources. ERIC makes every effort ♦ 

♦ to obtain the best copy available. Nevertheless, items of marginal ♦ 

♦ reproducibility are often encountered and this affects the quality ♦ 

♦ of the microfiche and hardcopy reproductions ERIC makes available ♦ 

♦ via the SP.IC Document Reproduction Service (EDRS) • EDRS is not ♦ 

♦ responsible for the quality of the original document. Reproductions ♦ 

♦ supplied by EDRS are the best that can be made from the original. ♦ 
********.*************************************************************** 



9 

ERIC 



o 



USE OF CLASSROOM DISTRIBUTIONS 
OF STUDENT ACHIEVEMENT TEST SCORES 
TO EVALUATE THE INSTRUCTIONAL 
EFFECTIVENESS OF TEACHERS 



Jinmie C. 
Dennis E. 
Robert B. 
Janice K. 



Fortune 
Hinfcle 
Frary 
McBee 



College of Education 
Virginia Polytechnic Institute 
and State University 
Blacksburg, Virginia 24061 



U S OEFAHTMENTOF HEALTH* 
EDUCATION ft WELFARE 
NATIONAL INSTITUTE OF 
EOUCATION 

THIS DOCUMENT HAS BEEN REPRO 
DUCED EXACTLY AS RECEIVED FROM 
THE PERSON OR ORGANIZATION ORIGIN 
ATINGIT POINTS OF VIEW OR OPINIONS 
STATED DO NOT NECESSARILY REPRE 
SENT OFFICIAL NATIONAL INSTITUTE OF 
EDUCATION POSITION OR POLICY 



O 



Presented at the Annual Meeting of the 
American Educational Research Association 

Division H Symposium: Process Evaluation: 
Methodological Attempts to Solve Some of Its Unique Problems 

Washington, D.C. 
April, 1975 



9 

ERLC 



Introduction 

One of the major barriers to the scientific study of education is the 
criterion problem, which still continues to be a source of academic debate. 
Without accepted criteria or appropriate methodology to deal with the cri- 
teria, the behavioral scientist has only a tentative basis for the establish- 
ment of educational accountability^ for the evaluation of educational inno- 
vations, for the assessment of teacher effectiveness, or for the validation 
of teachers 1 training methods. 

The criterion problem, itself, is complex in that it is compounded by 
several controversies. Among these are issues of either a conceptual or 
philosophical nature which are not directly subject to solution by the 
methods of the behavioral scientist. These issues usually focus upon the 
choice of suitable or appropriate criteria through which the effectiveness 
of schooling can be ascertained. These issues appear only indirectly per- 
tinent to the methodological issues associated with hew to deal with com- 
monly accepted criterion variables. The major focus of this paper is on 
the selection of a commonly accepted criterion variable and the testing 
of a new methodology for use in the study of teaching. Specifically, the 
purpose of this investigation is to determine the instructional effective- 
ness of classroom teachers through the use of distributions of student 
achievement scores. 

Literature Summary 

The relationship of teaching effort to changes in .student behavior as 
reflected by scores on achievement tests is presently unknown. Rosenshine 
CSmith, 1971), in reviewing recent process-product studies of the classroom 



using achievement data, points out the inconsistencies of current research 
results and the paucity of knowledge regarding the validity of the teacher 
training curriculum. Evaluators, for a lack of definitive measures, often 
rely upon simple teacher rating instruments as a means of ascertaining 
teacher effectiveness. This practice can be documented in almost any teacher 
training program [i.e., Stanford STEP program (Fortune, Cooper, and Allen, 
1969) or University of Illinois (Johnson, 1971)]. 

The change in student achievement scores appears as a potential cri- 
terion throughout the history of educational research. Rice (DuBois, 1970), 
in his earlier studies of spelling, relied upon student achievement as the 
dependent variable. Recent models designed to assess educational account- 
ability generally utilize school achievement as one of the major dependent 
variables. A good example of this practice is the New York City Accountability 
Model recently designed by Educational Testing Service (McDonald, 1973) which 
proposes to use student achievement means calculated at school levels cross- 
sectionally to determine successfully progressing schools s The performance 
criteria movement in teacher education has suggested that changes in student 
achievement scores should be regarded as the behavioral criterion used in 
the validation of selected training criteria (Cooper, 1970). Several national 
evaluations have utilized means of student achievement at both institutional 
and classroom levels to study the effects of intervention and specific educa- 
tional activities. The best example of these efforts can be found in the 
longitudinal evaluation of Project Follow-Through whose data were collected 
by Stanford Research Institutes and were analyzed by Abt Associates of 
Cambridge, Massachusetts. The national evaluation of the Emergency School 
Assistance Act presently being conducted by Systems Development Corporation 



of Santa Monica, California, under contract with the Office of Education, 
includes student achievement as ona of the primary dependent variables ♦ 

It is unfortunate that prior research using student achievement means 
would lead to the forecast that these studies would yield few, if any, 
results. Several possible explanations of these forecasts are apparent. 
Among these explanations is the fact that although the teacher is the 
delivery unit of the activity, students react to this stimulus differen- 
tially^ producing interactions which mask true treatment of teacher effects 
at the classroom level. In reality, the teachers may in fact fail to trans- 
mit the classroom treatment fully, giving some students more time and rein- 
forcement than they give to others. On the other hand, when using only 
classroom or school means, much data relative to the reception of the 
treatments or teaching uniformity are lost or averaged out. If there are 
differential student reactions to the stimulus, these are averaged out, 
and the potential of identifying treatment validity or teacher effects is 
lost. A few studies illustrate the potential of such differential re- 
actions, including the treatment across aptitude interaction studies by v 
Cohen, Snow, Berliner, and others. 

The Dilemma 

Studies to ascertain the effects of teaching upon student achievement 
have been the subject of several methodological disputes. Two appear to be 
major. They are the controversy concerning how to deal with gain scores 
and the controversy involved with the choice of the unit of analysis. 
Campbell, Porter, Cronbach and others have offered potential solutions to 
the gain score problem such that when hypothesized equal controls can be 
documented, it is no longer an insurmountable problem. However, the choice 
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of units of analysis still remains subject to debate. This paper attempts 
to propose a compromise to this problem without being subject to the criti- 
cisms of either side of the argument and within the limitations of the gain- 
score analysis. 

In the choice of units debate, the argumentation is directed toward 
determining which is the proper unit of analysis — the student in the class- 
room or the teacher who is the treatment delivery agent or the unit of 
study. The problem arises since the teacher or the classroom is the unit 
of concern in the study, but the students are the units upon which achieve- 
ment is measured. The behavioral scientists who maintain that the students 
are the proper unit of analysis argue that it is the individual student who 
receives the teacher stimulus and that "true" teacher effects amst be ob- 
served across these students. Those who maintain that the teacher or the 
classroom is the "true" unit of analysis argue that it is the teacher or 
classroom to which causality is to be attributed and that classroom as 
opposed to individual student effects is of primary interest. Hence, those 
who argue for students being the unit of analysis maintain the possibility 
of teacher-student interaction effects as the primary output of instruction. 
Those arguing for classrooms or teachers as the unit of analysis are willing 
to undergo the data losses involved with aggregating student achievement 
scores up to the proposed analysis unit. These data losses primarily in- 
volve losses of potential changes in classroom variance. 

The present investigation was exploratory in nature while attempting 
to provide further insight into the problem discussed above, the purpose 
being to determine the instructional effectiveness of classroom teachers 
through the use of distributions of student achievement scores. The primary 
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data for this study were the reading, language and arithmetic subtest scores 
on the Comprehensive Test of Basic Skills (CTBS) for fifth and sixth grade 
students in a large metropolitan school division. These students were tested 
during the fall and spring of the 1972-73 and 1973-74 school years. 

The first step in the investigation was to classify the students based 
upon the 1972-73 spring CTBS subtest scores. This classification was based 
upon their grade equivalent scores on each of the subtests; the classification 
was as follows : 

Slow Average - Fast 

Fifth Grade -4.9 5.0-6.8 >6.9 

Sixth Grade *5.9 6.0-7.8 >7.9 

Each student was classified by grade as well as by performance on the three 
subtests, i.e. Student #000 was a fifth grader, average in reading, average 
in language, slow in math. For each teacher in each of the two grades, the 
gain scores (in raw score points) were computed for each of his/her students 
on each of the thr&e subtests. The mean gain scores for the students on the 
respective subtests served as the derived data for the investigation. 
Specifically, each teacher had nine (9) data points; mean gain scores for 
slow, average and fast students in reading, language and arithmetic. 

To restate the problem in slightly different terms, the purpose of this 
exploratory investigation was to determine which teachers were not effective 
with which classification of student. Therefore in this investigation it 
was necessary to determine first of all the cluster of teachers who were 
mkt effective with certain students and then to follow these teachers with 
the second year of the study and investigate their assignment and their 
effectiveness. In this prccedure, the first step was to cluster the 
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teachers based upon the mean scores in the nine categories (i.e., the nine 
data points) using Baker's Numerical Taxonomy Package (1972). Following the 
cluster analysis, univariate single degree of freedom linear contrasts and 
multivariate simultaneous confidence intervals were computed to determine 
specifically which clusters of teachers differed significantly, as well as 
to determine on which of the nine data points they differed (in other words, 
which teachers differed in their effectiveness with which students). Due 
to the nature of this investigation, the a level for each of the univariate 
tests was established at .01 so, therefore, the multivariate level was 
1 - (1 - a) 9 » .09; the a level for the multivariate tests was .05. 

The results of this first stage of the study for the sixth grade 
teachers are found in Table 1. Four clusters of teachers were identified 
in the cluster analysis and as can be seen, the teachers in cluster 4 were 
significantly more successful than teachers in the other clusters with all 
levels of students based upon the student scores on the language subtest 
of the CTBS. The data also indicated that teachers in clusters 4, 2 and 1 
were significantly more successful with slow arithmetic students than 
teachers in cluster 3; and teachers in clusters 4 and 2 were more successful 
with fast arithmetic students than were teachers in cluster 3 and 1. 

The results for fifth grade teachers are found in Table 2. Three 
clusters of teachers were identified and the data indicate that the teachers 
in clusters 3 arid 1 were ^significantly more successful than teachers in 
cluster 2 with average students in reading and arithmetic based upon the 
students* scores on these subtests of the CTBS. Further, the teachers in 
cluster 3 were more significantly successful with fast language and fast 
arithmetic students than teachers in clusters 1 and 2; the teachers in 
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cluster 2 were more successful than teachers in cluster 1 with the latter 
students. 

The second stage of the analysis involved following these clusters of 
teachers into the 1973-74 school year and observing their class assignments 
in terms of the academic abilities of students. The teachers were classified 
based upon whether or not they were assigned to classes with distributions of 
students with which they were significantly more successful during the pre- 
ceding year, as measured by the three subtests of the CTBS. If such an 
assignment as made, these teachers were said to be in the "matched" .group; 
if it appeared that such an assignment was not made, then these teachers 
were said to be in the "non-matched" group. This matching was based upon 
the pre-test data for the 1973-74 school year. Thus the problem became the 
investigation of the difference between these two groups in terms of the 
performance of their students on the CTBS. 

The data for this stage of the analysis is found in Table 3. Multivariate 
Analysis of Variance (MANOVA, 1972) of these data resulted in an approximate 
7 value (Rao) equal to 3.718 (p - .027), i.e. there was a significant dif- 
ference between the two groups on the linear combination of the mean gain 
scores on the three subtests of the CTBS. Subsequently, simultaneous con- 
fidence intervals were computed (Kramer, 1973) and the results indicated 
that the students of the teachers in the "matched" group had significantly 
greater gains (p < .01) in reading, language and arithmetic than did the 
students of the teachers in the "non-matched" group. Due to problems with 
-the 1973-74 fifth grade data, a similar analysis for the fifth grade could 
not be performed. 

As indicated, this investigation was exploratory in nature; however, 
the researchers were able to conclude that these initial results were 

ERIC 8 



8 



encouraging. Within the obvious limitations of attempting to determine 
teaching effectiveness in terms of student achievement only, these initial 
data do indicate that it may be possible to determine that certain teachers 
can be more successful in working with certain types of students, in terms 
of their abilities and in various subject areas. It is important to note, 
however, that this investigation was primarily oriented toward looking at 
a specific methodology to attack a lingering problem in education. Further 
investigations are undoubtedly needed to validate this methodology — investi- 
gations that will need to regress other personality and demographic vari- 
ables on these classifications of teachers. 
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Table 1 



Grade 6 
Single Degree of Freedom 
Linear Contrasts 



Group #2 (Slow Language) 


Cluster 4 > Clusters 1, 2, 3 


Group #3 (Slow Mathematics) 


Clusters A, 2, 1 > Cluster 3 


Group #5 (Average Language) 


Cluster 4 > Cluster 3, 2, 1 


Group #8 (Fast Language) 


Cluster 4 > Clusters 3, 2, 1 


Group #9 (Fast Mathematics) 


Clusters 4, 2 > Clusters 3, 1 



Table 2 



Grade 5 
$ ingle Degree of Freedom 
Linear Contrasts 



Group #4 (Average Reading) 


Clusters 3, 1 > Cluster 2 


Group #6 (Average Mathematics) 


Clusters 1, 3 > Cluster 2 


Group #8 (Fast Language) 


Cluster 3 > Clusters 1> 2 


Group #9 (Fast Mathematics) 


Cluster 3 > Cluster 2 > Cluster 1 
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Table 3 

Mean Gain Scores for Matched 
and Non-Matched Groups on the 
1973-74 CTBS Subtests 
Grade 6 







Reading 


Language 


Arithmetic 


Matched 


N = 8 


X 


57.680 


61.456 


75.780 






s.d. 


9.013 


7.598 


7.694 


Non-Matched 


N - 17 


X 


48.070 


50.026 


65.148 






s.d. 


8.028 


9.105 


7.597 
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TABLE 1 12 
TEACHER GAIN MEANS AND STANDARD DEVIATIONS 
ACROSS COGNATE AREAS BY YEARS 
GRADE 5 



Teacher Reading Language ^Arithmetic 



i>u/ ieai 

l 


Level 

s 


-3.000 


it 

8 


8.71 


4v 

10.000 


5 


8.18 


-12.000 


7 


15.52 




A 


-12.750 


2 


7.41 


-8.500 


5 


9.57 


-21.500 


2 


7.32 


1973 


F 


-6.000 


5 


4.30 


-2.600 


3 


4.50 


-18.000 


6 


4.63 


1 


S 






















A 




















1974 


F 








































2 


S 


-8.750 


10 


8.18 


-21.250 


8 


12.81 


-20.250 


15 


25.01 




A 


-15.667 


3 


7.09 


-12.333 


2 


2.51 


-33.667 


6 


6.43 


1973 


F 


-5.500 


9 


6.28 


-2.833 


12 


4.79 


-14.333 


7 


2.16 


2 

mm 


s 


-7 in 

# . XXX 


Q 

7 


X£ . J7 


-lb 000 

14 • w w w 


6 


4.73 

4 • / mJ 


-29.500 


6 


6.41 

w . ti 




A 


-7.000 


5 


6.28 


-2.000 


11 


16.47 


-22.455 


11 


9.23 


1974 


F 




1 1 


7 £9 

6*47 


-5 son 


ft 


5 63 


-19 000 

17 . WWW 


7 


w • O w 


3 


s 


-21.000 

mm ^L, • WW 


2 


12.51 


- 24.000 


2 


4.00 


-36.400 


5 


14.38 




A 


-12.600 


3 


4.61 


-9.400 


7 


4.39 


-26.000 


2 


9.02 


1973 


F 


-3.000 


6 


4.39 


-4.000 


3 


3.62 


-19.000 


3 


4.19 


*j 




-in 


a 

o 


lO Qfl 


17 . 444 


o 

7 


11 41 

XX . 4X 


-30.900 

«JW • J \J \J 


10 

IV/ 


13.37 

1«J • ml t 




A 


-8.625 


8 


7.13 


-13.286 


7 


6.82 


-25.000 


11 


10.80 


1974 


F 


-2.750 


8 


3.01 


-5.429 


7 


4.72 


-13.667 


3 


3.06 


4 


s 


-1.000 


16 


4.65 


-8.714 


1 


0.00 


-19.571 


13 


13.99 




A 


-8.000 


5 


4.36 


-4.000 


15 


11.27 


-21.333 


7 


2.08 


1973 


F 


-2.000 


2 


4.00 


-10.500 


4 


2.12 


-17.500 


3 


0.71 


4 


s 


-5.250 


16 


40.97 


-12.263 


19 


10.62 


-22.933 


15 


11.66 




A 


-3.545 


11 


9.28 


-10.125 


8 


6.58 


-22.500 


10 


4.70 


1974 


F 














-16 i 000 


2 


5.66 


















5 


S 


-8.500 


9 


6.36 


-3.500 


11 


4.95 


-24.500 


10 


7.78 




A 


-13.000 


7 


2.12 


-16.500 


4 


0.71 


-27.500 


7 


3.54 


1973 


F 


-5.667 


4 


5.16 


-4.167 


5 


2.40 


-17.500 


2 


3.08 


5 


S 


-20.500 


2 


11.25 








-35.000 


4 


11.05 




A 


-7.250 


8 


2.96 


-12.400 


10 


4.45 


-23.500 


10 


5.25 


1974 


F 


-4.091 


11 


6.14 


-3.667 


9 


3.71 


-17.286 


7 


2.50 
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TABLE 1 
(continued) 



Teacher Reading Language ^Arithmetic 
ffo/Year Level x n s x n s x n s 



6 


C 

o 


-11.000 

-I. -I. • W V/ 


2 


7.78 


-9.000 


3 


17.68 


-28.000 


3 


7.65 




A 


-6.500 


8 


2.12 


-5.000 


10 


2.83 


-14.500 


8 


13.43 


1973 


F 


-5.857 


16 


4.52 


-8.000 


12 


4.20 


-17.857 


17 


4.81 


6 


S 









-19.800 


5 


16.04 


-26.667 


3 


21.57 




A 


-8.091 


11 


8.56 


-9.444 


18 


6.20 


-21.222 


9 


5.07 


1974 


F 


-6.722 


18 


2.78 


-5.000 


6 


r\ in 

2.19 


t * n p n 

-16 • 353 


17 


"T nn 

7.32 


7 


c 

D 


-6.500 


14 


8.23 


c n p n 

-5.250 


i / 
14 


n no 

9.22 


on c nn 

-20.500 


1 o 

13 


11 ^ o 

11.63 




A 


-10.500 


2 


10.66 


-7.000 


3 


11.22 


-26.500 


2 


3.11 


19/3 
■» 


F 


-10.000 


2 


2.81 


-17.000 


2 


3.83 


oi nnn 

-21.000 


2 


n n c 

2.25 


7 


S 






















A 




















1974 


F 









































8 


c 
D 


o nnn 

-3.000 


2 


11 in 

11.19 


-14.375 


*> 
2 


i o *?n 

13.70 


OO OCA 

— 2o. 250 


3 


7.94 




A 


-15.600 


7 


11.52 


-19.200 


10 


8.44 


-33.800 


5 


6.61 


19 73 


F 


-3.000 


16 


4.39 


—o. 000 


1 o. 
13 


3. 02 


—13 . 000 


1 "7 
1/ 


4. 19 


8 


S . 


-9.429 


7 


5.26 


-3.400 


5 


£ CO 

6.58 


i o cnn 
-13.500 


4 


7.27 




A 


-7.000 


8 


3.55 


-11.429 


7 


4.79 


-24.000 


2 


15.56 


1974 


F 


-1.600 


10 


3.81 


-3.077 


13 


3.32 


-16.500 


6 


6.09 


9 


S 


-12.750 


14 


19.79 


£ coo 

-6.583 


5 


£. O 

O.OJ 


-21. 750 


n 

2 


i n £n 
19.59 




A 


-6.000 


8 


4.24 


-9.000 


12 


4.24 


-18.000 


14 


5.66 


1973 


F 


o nan 
— O.DD7 


2 


2.08 


c nnn 
-3. 000 


0 


7.47 


— lo • J J J 




/• n/i 
4.04 


9 


S 


-7.250 


8 


10.17 


in 

-13.143 


7 


in " / n 

10.42 


nn nnn 

-20.000 


5 


1 o o c 

18.85 




A 








— J. UUU 


i 
l 


n nn 
0. 00 


— lo . 000 


3 


J. 51 


1Q7A 
±y t h 


F 








































10 


s 


-7.714 


12 


6.97 


-14.571 


13 


11.12 


-23.286 


ll 


14.07 




A 


-5.000 


12 


2.12 


-10.000 


9 


4.24 


-19.500 


8 


4.95 


~~1973 


F 


-4.667 


3 


2.31 


-2.333 


4 


2.08 


-13.000 


7 


1.73 


10 


S 




















A 




















1974 


F 
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TABLE 1 
(continued) 



Teacher 
No A .ear 



erJc 



11 

1973 



11 

1974 



12 
1973 



12 
1974 



13 
1973 



13 
1974 



14 
1973 



14 
1974 



15 
1973 



15 
1974 



Level 



Reading 
x n s 



Language 
x~ n 



_Arithmetic 

x. n 



S 
A 
F 



S 
A 
F 



S 
A 
F 



S 
A 
F 



S 
A 
F 



S 
A 
F 



S 
A 
F 



S 
A 
F 



S 
A 
F 



-8.600 
-8.200 
-10.500 



13 17.61 
7 6.94 
5 3.54 



-8.467 
-9.250 
3.000 



15 11.98 
8 7.32 
5 19.84 



-13.800 
-12.500 
-4.500 



6 14.46 
8 5.24 
4 4.95 



-5.818 11 
-4.000 1 



6.16 
0.00 



-9.400 
-10.200 
-4.000 



12 14.46 
3 6.91 
2 2.83 



-6.857 
-5.000 



7 
2 



7.01 
2.83 



-15.400 5 
-11.500 7 
-5.750 11 



9.42 
6.36 
2.87 



-15.125 8 
-8.333 9 
-6.667 3 



9.11 
5.07 
2.52 



-8.000 5 12.17 
-4.500 10 4.95 
-3.000 9 3.55 



-10.000 4 
-8.455 11 
-2.364 11 



1.83 
5.20 
4.80 



-12.600 15 14.98 
-12.400 7 2.07 
-11.500 3 2.12 



-14.765 17 12.39 
-14.571 7 4.69 
-1.750 4 6.13 



-17.000 — 

-13.333 

-5.500 



9.92 
6.31 
2.12 



-6.700 
-9.091 
-7.500 



10 
11 

2 



7.96 
5.22 
4.95 



-18.690 8 17.66 
-23.400 12 10.92 
-19.000 3 5.66 



-30.917 
-25.778 
-16.667 



12 14.84 
9 7.08 
6 8.76 



-23.200 6 20.09 
-20.667 8 9.22 
-18.000 4 2.83 



-17.000 — 
-15.000 — 
-6.500 — 



9.92 
4.85 
3.00 



-7.308 
-9.000 



13 
11 



8.20 
5.81 



-23.000 5 11.98 
-8.500 10 0.71 
-4.000 8 5.89 



-16.600 10 10.76 
-15.286 7 3.25 
-10.000 2 2.83 



-9.000 6 7.68 
-13.500 10 9.19 
-5.000 11 3.73 



-6.667 3 4.93 
-10.857 14 4.31 
-2.833 6 4.62 



17 



-20.125 
-18.500 
-14.500 



8 7.99 
10 6.11 
6 7.50 



-22.900 9 20.09 
-20.200 7 6.50 
-20.000 2 3.74 



-19.643 14 12.09 
-19.286 7 8.63 
-17.000 3 2.65 



-52.200 4 9.83 
-23.000 11 4.24 
-18.000 8 3.37 



-34.167 12 12.45 
-27.167 6 4.17 



-27.600 4 
-26.000 2 
-18.000 4 



-35.375 8 
-29.071 14 
-19.000 1 



7.06 
2.83 
3.13 



7.96 
6.32 
0.00 



15 



TABLE 1 
(continued) 



Teacher 
No/Year 



Level 



Reading 
x n s 



Language 
x n 



_Arithmetic 
x n s 



16 

1973 



S 
A 
F 



-21.000 
0.500 
-2.000 



9 13.13 
8 2.12 
7 1.41 



-20.714 7 11.01 
-15.500 12 6.36 
-5.500 4 5.89 



■33.571 
-23.000 
■13.500 



8 6.13 
14 5.66 
2 7.78 



16 
1974 



S 
A 
F 



-6.000 
-9.727 
-6.143 



9 
11 
7 



8.85 
6.86 
4.30 



-12.000 
-7.667 
-7.286 



14 
6 
7 



8.37 
5.72 
6.32 



■31.333 3 13.32 
■22.789 19 7.02 
-16.000 5 18.51 



17 
1973 



S 
A 
F 



-14.650 21 14.13 
-8.000 7 2.00 
-1.000 8 4.39 



-13.400 
-10.667 
9.000 



20 15.04 
10 7.37 
6 3.62 



-28.950 
-24.000 
-14.000 



20 15.44 
14 3.46 
2 4.19 



17 
1974 



S 
A 
F 



1.794 
5.750 
7.600 



34 12.01 
8 5.60 
5 7.13 



-5.485 33 10.34 
-1.000 8 12.34 
-7*000 2 1.41 



-17.765 34 11.22 
-13.875 8 5.72 
-18.000 1 0.00 



18 

1973 



S 
A 
F 



-15.500 
-15.500 
-6.000 



13 
13 
2 



9.19 
6.36 
7.21 



-15.500 
-14.000 
-4.333 



14 16.26 
13 12. 73 
2 2.08 



-24.500 
-32.000 
-18.667 



15 
13 
1 



7.78 
1.41 
0.00 



18 

1974 



S 
A 
F 



-7.440 
-9.500 
-3.000 



25 12.09 
4 10.66 
1 0.00 



-6.739 23 10.35 
-4.500 2 10.61 
-11.000 1 0.00 



-4.882 17 15.25 
-3.500 8 13.96 
-4.000 1 0.00 



19 

1973 



S 
A 
F 



-5.800 
-2.000 
-5.000 



8 12.44 

2 5.00 

3 4.24 



-1.200 7 
-13.000 4 
5.000 2 



5.80 
8.87 
5.66 



2.000 7 8.06 
-33.000 2 9.00 
-14.000 2 22.63 



19 
1974 



S 
A 
F 



-0.833 6 4.75 
29.333 3 18.77 
41.600 5 20.35 



-3.000 
27.333 



7 11.78 
6 24.18 



-9.400 10 16.32 
24.000 3 13.11 



20 
1973 



S 
A 
F 



-3.333 14 10.17 
-il.000 8 4.55 
-6.000 5 19.94 



-7.333 14 15.02 
-2.000 10 4.90 
1.000 3 15.70 



■21.778 15 12.11 
■21.205 9 8.30 
■19.000 8 25.07 



20 
1974 



S 
A 
F 



-4.640 28 9.15 



-7.517 29 12.89 
9.000 1 0.00 



-13.536 28 
-22.500 2 



15.58 
6.36 



16 

TABLE 1 
(continued) 



Teacher Reading _ Language ^Arithmetic 
No/Year Level ~* n s x n s x n s 



21 
1973 


S 
A 
F 


-24.000 
-lO.OOu 
-11.000 


10 
4 

5 


14.31 
5.66 
4.87 


-23.500 
-12.500 
-10.000 


8 
7 
4 


11.7 
0.71 
3.89 


-41.750 
-31.500 
-16.000 


11 

2 
6 


8.96 
3.54 
4.37 


21 






















s 

A 
F 




















1974 








































22 
1973 


S 
A 
F 


-4.667 
-12.000 
-4.000 


8 
3 
4 


17.01 
4.24 
2.39 


-13.000 
-17.000 
-1.000 


5 
6 
4 


10.44 
5.66 
5.62 


-28.333 
-22.000 
-12.000 


7 
2 
6 


24.54 
8.48 
3.42 


22 






















S 
A 




















1974 


F 








































1973 


S 
A 
F 




















1974 


S 
A 
F 












* 


• 






1973 


S 
A 
F 




















1974 


S 
A 
F 




















-1973 


S 
A 
F 




















1974 


S 
A 
F 





















TABLE 2 

TEACHER GAIN MEANS AND STANDARD DEVIATIONS 
ACROSS COGNATE. AREAS BY YEARS 
GRADE 6 



ERIC 



Teacher 
No/Year 



1 

1973 



1 

1974 



2 

1973 



2 

1974 



3 

1973 



3 

1974 



4 

1973 



4> 

1974 



5- 
"1973 



5 

1974 



Level 



Reading 
x • n 



Language 



Arithmetic 



n 



n 



S 
A 
F 



S 
A 
F 



S 
A 
F 



S 
A 
F 



S 
A 
F 



S 
A 
F 



S 
A 
F 



S 
A 
F 



S 
A 
F 



S 
A 
F 



2.429 19 
0.000 5 
-1.333 6 



8.70 


8.429 


2 


7.48 


8.54 


3.000 


3 


7.00 


1.53 


4.667 


8 


8.14 



-9.667 6 7.31 
16.333 3 18.77 
2.000 2 8.49 



-0.750 14 9.71 
1.833 6 7.78 
1.750 8 4.06 



1.000 12 8.06 
7.375 8 6.59 
1.900 10 3.28 



3.250 
5.167 
2.429 



10 
6 
2 



8.62 
7.83 
4.79 



8.222 9 8.27 
10.600 5 6.39 
2.250 8 3.77 



-2.000 
9.000 
0.000 



8 11.58 
4 3.51 
3 4.02 



11.625 
12.400 
3.000 



16 
5 
2 



6.84 
7.64 
1.41 



-11.000 18 2.34 
7.000 1 0.00 
4.091 13 5.47 



-10.600 5 
1.714 7 
0.556 18 



14.26 
8.24 
5.64 



12.143 7 13.72 
10.500 2 4.95 
3.000 2 1.41 



10.750 18 16.46 
6.000 5 5.25 
3.750 4 4.65 



5.889 9 
7.875 8 
4.917 12 



8.46 
3.72 
5.45 



10.500 2 
7.000 7 
7.143 9 



5.07 
5.66 
4.06 



6.571 19 13.83 
3.667 9 15.53 
7.000 2 4.58 



11.250 4 7.63 
1.750 21.41 
6.000 2 0.00 



-1.250 16 12.87 
7.000 7 5.51 
2.500 5 1.85 



3.273 11 11.34 
9.500 8 3.55 
5.727 11 4.76 



8.800 
7.375 
4.000 



10 10.85 
8 9.84 
3 5.57 



26.833 3 12.22 
64.000 7 0.58 
65.000 5 5.95 



9.000 
20.000 
2.818 



15 22.05 
11 7.00 
5 5.19 



3.500 8 
3.000 7 
4.600 15 



9.93 
6.68 
4.24 



-0.750 9 12.07 
4.500 8 4.85 
2.000 2 2.77 



10.000 7 9.81 
12.000 11 11.97 
4.000 4 6.32 



1.833 10 14.13 
8.000 3 6.11 
2.000 2 3.50 



24.091 11 8.73 
25.571 7 13.30 
29.000 5 12.29 



-16.000 
20.000 
4.364 



19 29.67 
9 5.51 
3 5.14 



6.000 3 14.93 
2.400 10 7.28 
5.000 17 4.90 



20 



TABLE 2 
(continued) 



18 



Teacher Reading 
No/Year Level x n s 



6 

1973 



1974 



7 

1973 



7 

1974 



8 

1973 



8 

1974 



9 

1973 



9 

1974 



10 



-^L973 



10 
1974 



9 

ERIC 



s 

A 
F 



S 
A 
F 



S 
A 
F 



S 
A 
F 



S 
A 
F 



S 
A 
F 



S 
A 
F 



S 
A 
F 



S 
A 

F 



S 
A 
F 



_ Language 
x n 



s 



-10.875 
-6.000 
-6.000 



14 14.38 

6 8.82 

7 21.21 



-1.273 18 
10.000 8 
-2.000 2 



7.30 
5.66 
4.58 



12.125 15 10.45 
37.000 7 13.86 
23.000 5 37.48 



-0.545 
15.500 
8.000 



14 9.84 
li 0.71 
3 1.52 



1.500 
-4.222 
1.800 



16 
9 
5 



8.01 
7.07 
3.96 



-1.500 
6.500 
7.000 



12 
4 
6 



4.81 
6.19 
3.57 



0.688 16 
1.000 7 



9.31 
8.60 



2.286 5 
10.500 10 
1.250 11 



7.30 
3.54 
3.10 



-9.000 1 
1.200 10 
1.000 9 



0.00 
5.81 
2.74 



1.167 
2.200 
0.000 



22 
3 
2 



7.20 
5.97 
6.96 



4.571 14 
1.222 9 
2.000 4 



5.97 
6.91 
2.16 



1.357 
11.571 
6.429 



14 
7 
7 



6.11 
8.42 
5.50 



_Arithmetic 
x n s 



-5.500 
-7.000 
1.000 



18 
8 
5 



-0.800 
0.778 
6.500 



15 
9 
6 



8.875 
22.250 
3.000 



12 8.48 
3 28.14 
7 1.36 



8.706 17 
16.000 5 



5.18 
8.34 



6.857 9 7.22 
16.000 7 1.41 
6.250 9 5.68 



5.800 10 
6.500 10 



9.73 
5.08 



9.333 
8.800 
1.000 



15 13.28 
5 4.44 
3 9.08 



11.353 
8.600 
8.667 



17 

5 
3 



7.86 
7.30 
4.04 



0.182 11 
10.333 3 



10.143 
14.000 
1.250 



4 
10 

2 



2.800 10 
1.125 8 



5.87 
5.89 
11.31 



-9.909 14 10.86 
7.500 12 12.02 
5.000 2 4.39 



8.34 
5.87 
3.51 



8.500 12 10.57 
0.250 5 2.87 
3.000 5 7.86 



5.83 
6.03 



9.49 
9.90 
4.03 



6.14 
4.88 



5.417 23 15. 12 
10.800 2 7.12 
1.000 2 1.29 



6.000 11 
3.333 6 
8.000 2 



7.28 
4.46 
1.41 



21 



TABLE 2 
(continued) 



19 



Teacher 



ERIC 



Level 



Reading 
x n 



Language 
x n 



^Arithmetic 
x n s 



1 1 


s 


1 H77 
X.U/ / 


i n 
xu 


3 • OO 


9. n77 
J .u/ / 


1 


A A** 


9 fl77 
X . u/ / 


j. j. 


0 A? 




A 


2.000 


8 


5.65 


6.000 


3 


2.83 


4.000 


6 


7.12 


1973 


F 


—i nnn 

X • UUU 


C 

3 


9. in 
J • xu 


^ ooo 

i J . UUU 


A 


5 nft 


91 000 
£J. . UUU 


5 


A 09 

H. U3 


XX 


S 


U • Ufo 


91 
ZX 


11 19 
XX. X/ 








9 909 


99 


- 7 95 
/ . £3 




A 


5.500 


2 


2.12 


8.000 


l 


0.00 


4.000 


2 


1.41 


19/4 


F 










































12 


S 


9.000 


3 


11.83 


9.000 


3 


1 / / o 

14.48 


i o nnn 
18 • 000 


2 


7 C£ 
7 .30 




A 


-2.333 


13 


3.67 


4.833 


1 


0.00 


8.333 


3 


5.78 


1973 


F 


7 OAA 
/ • ZUU 


Q 
J 


3. t>7 


c nnn 
3 .UUU 


O 
/ 


1 7Q 
X. / J 


9. onn 


i 

X 


n nn 
u.uu 


12 


S 


4.273 


11 


O OO 

o. 83 


o 7 Ann 
37.000 


1 


n nn 
U. UU 


1 1 7^n 
XX. /3U 


fi- 
ts 


11 1 £ 

xx.xo 




A 


5.000 


6 


5.29 


Oft /\/\/\ 

29.000 


1 


A AA 

0.00 


14.625 


o 
o 


11. OO 


1 AT/ 

1974 


F 


O AAA 

3.800 


5 


3.03 


• /. o Ann 
42.000 


J 


J. 4o 


1 9 nnn 
X J . UUU 




/. 9A 
4. JO 


13 


S 


13.800 


5 


10.06 


30.600 


1 


0.00 


Oft S\/\/\ 

29 • 000 


6 


21.11 




A 


31.000 


12 


5.70 


33.000 


8 


5.00 


65.000 


9 


9.37 


1973 


F 


en nnn 
•UUU 


XX 


£ 71 
O. /X 


9A nnn 

JO . UUU 


1 

X3 


9 ft9 

Z . o* 


—9 000 

£ . UUU 


1 ^ 


9 nft 
Z . OO 


i 9 

XJ 


S 






















A 














, .i.i u 1 






1974 


F 








































1 A 
X*f 


s 


^ nnn 


1ft 


22 90 


—9 000 

7 . www 


14 


5.77 


-5 . 000 


13 


13.75 




A 


4.333 


5 


18.15 


12.000 


4 


13.11 


10.667 


10 


2.31 


1 O 7 O 

19/3 


F 


0 091 


7 

i 


J . to 


6.636 

w . VJV 


A 

w 


3.83 


2.636 


7 


2.91 


X4 


c 
o 


1 ££7 




R Rl 
3 • 3X 


i 9 >%nn 

X J • 3UU 


2 


n 7i 

u . /X 


<> ooo 

3 . UUU 


9 


3 . OO 




A 


4.700 


10 


8.64 


11.300 


10 


6.46 


17.083 


12 


12.62 


1974 


T? 
& 


o Ann 
z . *fUU 


i n 
xu 


A 1 A 


7 979 
/ . 4. / J 


11 


7 71 


5 AAA 




4 61 

*T . OX 


15 


s 


4.667 


15 


7.42 


10.000 


2 


12.71 


10.000 


13 


11.47 




A 


4.800 


12 


9.76 


16.800 


5 


9.26 


7.000 


10 


6.04 


"1973 


F 


5.000 


2 


1.41 


11.000 


5 


5.66 


15.000 


5 


0.72 


15 


S 


6.333 


6 


14.79 


12.500 


4 


8.66 


7.167 


6 


24.31 




A 


-0.200 


5 


5.36 


8.625 


8 


7.98 


7.800 


5 


5.45 


1974 


F 


3.500 


8 


4.99 


2.500 


6 


5.92 


6.750 


8 


6.45 



TABLE 2 
(continued) 



20 



Teacher Reading Language Arithmetic 

N'o/Year Level x n s x n s x n s 



16 


S 


1.571 


13 


8.52 


8.714 


18 


10.80 


3.857 


13 


11.91 




A 


3.000 


3 


0.00 


6.333 


2 


0.58 


7.333 


5 


13.32 


1973 


F 


-9.000 


7 


4.24 


3.000 


2 


9.90 


-2.000 


4 


12.73 


16 


s 


-0 . 450 


20 


10.27 

JLW • mm 1 


6.294 

W • mm m* "T 


17 


9.69 


7.091 


11 


11 61 

1 1 m \J mm. 




A 


1.500 


6 


4.93 


7.111 


9 


5.30 


18.077 


13 


16.42 


1974 


F 


0.000 


2 


1.41 


4 000 

•? • WWW 


2 


2 83 

mm 9 \J <mf 


12 . 500 


A 


5 74 


17 


s 


0.455 


20 


9.92 


3.545 


7 


10.54 


4.000 


15 


6.96 




A 


4.000 


3 


6.96 


15.000 


5 


0.38 


8.000 


6 


4.01 


1973 


F 


6.500 


4 


4.95 


18 . 000 


3 


5.66 


5.500 


7 


2.12 


17 


s 


3.471 


17 


6.91 


8.938 


16 


8.95 


9.067 


15 


9.07 




A 


2.000 


4 


9.31 


5.500 


4 


10.25 


4.333 


3 


1.15 


1974 


F 


5.750 


4 


0.96 


8.667 


3 


2.08 


10.000 


5 


6.16 


18 


s 


-1.077 


8 


9.87 


25.615 


5 


10.07 


8.231 


5 


11.08 




A 


4.000 


14 


2.12 


38.000 


3 


7.77 


-1.000 


16 


3.54 


1973 


F 


-1.000 


6 


7.19 


52.000 


1 


2.81 


8.000 


1 


0.00 


18 


s 


1.533 


15 


8.00 


20.000 


1 


0.00 


12.100 


10 


11.50 




A 


6.000- 


4 


2.16 








11.333 


9 


6.58 


1974 


F 


1.750 


4 


2.36 








12.500 


2 


16.26 


19 


s 


-1.214 


12 


14.32 


8,429 


8 


13.26 


6.071 


9 


29.00 




A 


-1.000 


7 


7.75 


11.000 


8 


3.20 


2.000 


10 


5.34 


1973 


F 


5.667 


9 


2.08 


16 . 000 


5 


17.78 


10.000 


5 


7.94 


19 


s 


-10.556 


9 


17.17 








2.167 


6 


10.23 




A 


-5.000 


1 


0.00 








1.000 


1 


0.00 


1974 . 


F 










































20 


S 


9.400 


5 


7.60 


33.800 


9 


19. 70 


18.800 


7 


6.34 




A 


2.000 


7 


2.12 


51.000 


7 


20.71 


17.000 


14 


0.71 


"1973 


F 


6.000 


22 


7.63 


53.000 


25 


6.67 


17.000 


19 


2.54 


20 


S 


11.118 


17 


8.37 


11.000 


1 


0.00 


14.313 


16 


11.67 




A 


13.167 


6 


11.92 








18.571 


7 


12.30 


1974 


F 


3.000 


2 


4.24 








16.667 


3 • 


8.50 



ERIC 23 



21 



TABLE 2 
(continued) 



Teacher 
No/Year 



9 

ERIC 



21 
1973 



21 

1974 



22 
1973 



22 
1974 



23 
1973 



23 
1974 



24 
1973 



24 
1974 



25 
"l973 



25 
1974 



Level 



Reading 
"x n 



s 



Language 
x n 



Arithmetic 



n 



S 
A 
F 



S 
A 
F 



S 
A 
F 



S 
A 
F 



S 
A 
F 



S 
A 
F 



S 
A 
F 



S 
A 
F 



S 
A 
F 



S 
A 
F 



0.250 
2.500 
6.000 



17 10.21 
12 2.12 
6 4.95 



12.000 
15.750 
-1.000 



24 13.08 
4 13.43 
2 9.90 



■5.000 
-1.000 
8.000 



11 

9 
6 



7.67 
7.00 
7.47 



1.636 11 
2.000 5 



8.88 
9.77 



-0.286 
-3.000 
5.667 



5 

4 
3 



7.95 
2.12 
3.51 



0.875 8 
5.714 7 
3.333 6 



7.79 
6.52 
2.88 



-1.625 26 
0.000 2 
2.750 3 



6.93 
3.20 
5.06 



2.167 
-2.857 
1.333 



12 
7 
3 



8.52 
4.18 
2.08 



-5.000 14 11.31 
0.000 2 3.20 
1.000 7 5.57 



1.267 
0.000 
2.333 



15 
5 
3 



9.21 
6.40 
3.51 



28.000 
29.500 
64.000 



14 19.36 
12 41.72 
8 1.41 



3.333 3 17.67 



46.000 
40.000 
78.000 



8 13.32 

9 8.43 
9 2.14 



-4.000 



0.00 



12.000 
9.000 
15.667 



4 
6 
2 



6.24 
2.42 
12.50 



17.000 
5.444 
0.000 



5 7.97 
9 7.28 
2 2.83 



1.625 17 5.66 
20.000 3 2.13 
12.250 9 4.65 



7.000 11 7.31 
17.400 5 9.10 
8.500 2 12.02 



0.000 
-6.000 
7.333 



4 18.38 
20 6.51 
2 2.31 



5.333 
5.400 
11.000 



9 9.10 
5 9.76 
3 6.08 



10.000 
18.500 
22.000 



13 10.13 
9 0.71 
5 4.24 



20.440 16 13.63 
16.667 9 7.30 
15.000 3 3.61 



10.000 6 
4.000 13 
6.000 7 



-1.667 
' 4.333 



12 

3 



6.780 
10.889 
9.667 



7.250 15 
16.000 11 
8.000 3 



0.833 
8.846 
4.667 



-15.000 
-2.000 
2.667 



9.84 
1.73 
6.41 



9.19 
2.31 



12.571 9 11.57 
10.000 11 16.97 
6.000 2 8.19 



9 10.94 
9 11.13 
3 8.02 



7.85 
5.63 
2.16 



6 21.76 
13 8.13 
3 4.93 



9 34.65 
15 6.66 
6 5.13 



-0:333 12 9.77 
8.000 10 10.74 
1.000 1 0.00 



24 



22 



TABLE 2 
(continued) 



Teacher 
No/Year 



Level 



Reading 
x n 



Language 



n 



_Arithmetic 
x n s 



26 
1973 



S 
A 
F 



-3.800 10 
13.000 19 
-1.500 6 



4.32 
4.10 
4.95 



19.000 
11.000 
5.500 



12 21.27 
18 6.41 
5 2.12 



5.600 
8.000 
3.000 



21 11.55 
13 3.28 
4 1.56 



26 



1974 



27 
1973 



S 
A 
F 



S 
A 
F 



-9.167 36 
0.286 7 



13.81 
6.63 



-1.485 
7.667 
3.333 



33 11.49 
3 10.07 
3 3.51 



9.080 
8.300 
13.000 



25 10.12 
10 8.81 
4 10.98 



9.733 
3.000 
-5.000 



15 8.03 
3 5.66 
6 4.97 



9.667 16 
6.000 11 
-3.000 5 



8.20 
4.24 
2.13 



9.000 18 7.57 
14.000 5 8.48 
0.000 3 4.14 



27 
1974 



28 
1973 



S 
A 
F 



S 
A 
F 



1.625 8 15.90 
8.750 16 10.57 
9.375 8 12.13 



13.125 8 16.00 
9.529 17 7.92 
-0.333 6 3.50 



0.227 22 10.17 
0.800 10 5.88 



3.556 9 
5.500 10 
4.000 2 



3.68 
0.71 
6.77 



6.111 
9.000 
7.000 



10 
9 
2 



7.11 
2.83 
3.18 



15.333 8 8.19 
15.500 12 9.19 
9.000 1 0.00 



28 
1974 



S 
A 
F 



29 
1973 

29 
1974 



1973 



1974 



S 
A 
F 



S 
A 
F 



S 
A 
F 



S 
A 
F 



-9.000 
-2.000 
2.000 



9 
3 
1 



8.82 
4.24 
0.00 



-7.000 
10.500 
-2.000 



6 13.86 
11 9.19 
3 7.64 



19.000 10 5.89 
9.500 9 9.23 
11.000 1 0.00 



